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1 . A method of merging images of segments of a view, comprising: 

receiving^ first image representing a first segment of the view and a second image 
representing a sfecond segment of the view from a remote location over a network; 

determining tke position of the second segment of the view relative to the first 
segment of the view; 

blending the firsKimage with the second image based on the determined position of 
the second segment relative to the first segment to merge the first image and the second 
image into a panoramic image of the view; and 

transmitting the panoramic image over the network; 

wherein the step of determining the position and the step of blending are performed 
without positioning information from a human operator. 

2. The method of claim 1 further comprising: 

determining whether thei second image overlaps the first image based on the position 
of the second segment relative to the first segment, wherein the blending the first image 
and the second image is only performed when the second image overlaps the first image. 

3. The method of claim 1 further comprising: 

correcting perspective distortion in the second image relative to the first image prior 
to blending the first image withtthe second image. 

4. The method of claimSJ wherein blending the first image with the second image includes: 

dividing the second nn^e into a first portion and a second portion, based on the 
position of the second segment relative to the first segment; 

compositing the first portion of the second image on the first image at the relative 
position of the second segment relative to the first segment to produce the panoramic 
image, the compositing of the Erst portion of the second image causing the first portion to 
mask out a part of the first imag^ 



- 18- 



Attorney Docket No.: 07844- 



/P422 




A method onmerging images of segments of a view, comprising: 

retrieving^, set of images representing a view including a first image representing a 
first segment oXthe view, a second image representing a second segment of the view, and 
a third image representing a third segment of the view; 

determining a i^rst position of the second segment of the view relative to the first 
segment of the vie\ 

determining a second position of the third segment relative to the first segment of the 
view and a third position of the third segment relative to the second segment of the view; 

checking whether th^irst image overlaps the third image more than the second 
image overlaps the third image, based on the second position and the third position; 

if the first image overlapsithe third image more than the second image overlaps the 
third image, blending the set onjmages based on the first position and the second 
position. 



6. The method of claim 5 further comprising: 

correcting perspective distortion in a^least one of the set of images prior to blending 
the set of images. 

7. The method of claim 5 further comprising: 

prior to blending the set of images: 

determining a central one and peripheral ones of the set of images based on 
the first and second positions; and 

correcting perspective distortion in [a first peripheral one of the images relative 
to the central one of the images. 



8. The method of claim 7 further comprising 

prior to correcting perspective distortion ill 
determining overlap areas between 
ones of the set of images, based on the first ar 
selecting the first peripheral one o 



the first peripheral one of the images: 
the central one and each of the peripheral 
d second positions; 

the images to maximize the overlap area 



between the central image and the first peripheral one of the images. 
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9. The method onclaim 8 further comprising: 

prior to blenciing the set of images: 

determining a first overlap area between a second one of the peripheral images 
and the central one* of the images; 

determining a second overlap area between the second one of the peripheral 
images and the first peripheral one of the images; 

if the firstloverlap area is greater than the second overlap area, correcting 
perspective distortion tin the second one of the peripheral images relative to the central 
one of the images. \ 

10. The method of claim 9 further comprising: 

prior to blending the set of images: 

if the first ovemap area is less than the second overlap area, correcting 
perspective distortion in the second one of the peripheral images relative to the first 
peripheral one of the images. 

1 1 . The method of claim 5, wherein blending the set of images further includes: 

dividing the second image Wo a first portion and a second portion, based on the first 
position; \ 

compositing the first portionW the second image on the first image at the first 
position to produce a composite image; the compositing causing the first portion to mask 
out a part of the first image; \ 

blending the third image with tne composite image to form the panoramic image. 

12. The method of claim 1 1 wherein blending the third image with the composite image 
further includes: \ 

dividing the third image into a third portion and a second portion, based on the second 
position; \ 

dividing the third portion into a fifthVportion and a sixth portion, based on the third 
position; and \ 

compositing the fifth portion of the third image on the composite image based on the 

second position to form the panoramic image, the compositing of the fifth portion causing 

the fifth portion to mask out a part of the composite image. 
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1 1 3. A method of merging images of segments of a view, comprising: 

2 transmitting a fiist image representing a first segment of the view to a server; 

3 transmitting a second image representing a second segment of the view to the server 

4 without providing any\information about the position of the second segment relative to 

5 the first segment; and 

6 receiving a panoramic image of the view from the server, the panoramic image being 

7 a composite of the first image and the second image. 

1 14. The method of claim 14, wherein the first image is transmitted from a first computer and 

2 the second image is transmitted from a second different computer. 

15. An article comprising a computer-readable medium on which are tangibly stored 
computer-executable instructions for merging images of segments of a view, the stored 
instructions being operable toWuse a computer to: 

receive a first image representing a first segment of the view and a second image 
representing a second segment of the view from a remote location over a network; 

determine the position of the\second segment of the view relative to the first segment 
of the view; 

blend the first image with the iecond image based on the determined position of the 
second segment relative to the first segment to merge the first image and the second 
image into a panoramic image of the view; and 
transmit the panoramic image over the network. 

1 16. The article of claim 16 wherein the instructions that determine the position and blend the 

2 first and second images operate without positioning information from a human operator. 

1 17. The article of claim 16 wherein the stored instructions further comprise instructions 

2 operable to cause the computer to: 

3 determine whether the second image (Werlaps the first image based on the position of 

4 the second segment relative to the first segment, wherein blending the first image and the 

5 second image is only performed when the second image overlaps the first image. 
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18. The article of claim 16 wherein the stored instructions further comprise instructions 
operable to cause the^omputer to: 

correct perspectiveXdistortion in the second image relative to the first image prior to 
blending the first image wth the second image. 

19. The article of claimMi) wherein blending the first image with the second image includes: 

dividing the secondSmage into a first portion and a second portion, based on the 
position of the second segmept relative to the first segment; 

compositing the first ponton of the second image on the first image at the relative 
position of the second segment relative to the first segment to produce the panoramic 
image; the compositing of the first portion of the second image causing the first portion 
to mask out a part of the first image. 



^\"""^0. An article compiling a computer-readable medium which stores computer-executable 

2 instructions for merging images of segments of a view, the instructions being operable to 

3 cause a computer to: 

retrieve a set of images Representing a view including a first image representing a first 
segment of the view, a secondYmage representing a second segment of the view, and a 
third image representing a third \egment of the view; 

determine a first position of tn% second segment of the view relative to the first 
segment of the view; 

determine a second position of tlte third segment relative to the first segment of the 
view and a third position of the third segment relative to the second segment of the view; 

check whether the first image ovenlaps the third image more than the second image 
overlaps the third image, based on the second position and the third position; 

if the first image overlaps the thirdlimage more than the second image overlaps the 
third image, blend the set of images baked on the first position and the second position. 

21. The article of claim 21 wherein the stored instructions further comprise instructions 
operable to cause the computer to: 

correct perspective distortion in at l^ast one of the set of images prior to blending the 
set of images. 
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1 22. The article ofUaim 21 wherein the stored instructions further comprise instructions 

2 operable to causXthe computer to: 

3 prior to blending the set of images: 

4 determine a central one and peripheral ones of the set of images based on the 

5 first and second positions; and 

6 correcting perspective distortion in a first peripheral one of the images relative 

7 to the central one of the images. 

1 23. The article of claim 23 wherein the stored instructions further comprise instructions 

2 operable to cause the computer to: 

3 prior to correcting perspective distortion in the first peripheral one of the images: 

4 determining overlap areas between the central one and each of the peripheral 

5 ones of the set of images, Based on the first and second positions; 

6 selecting the first peripheral one of the images to maximize the overlap area 

7 between the central image and the first peripheral one of the images. 

1 24. The article of claim 24 wherein the stored instructions further comprise instructions 

2 operable to cause the computer to: 

3 prior to blending the set onimages: 

4 determining a first overlap area between a second one of the peripheral images 

5 and the central one of the images; 

6 determining a second ©verlap area between the second one of the peripheral 

7 images and the first peripheral onelof the images; 

8 if the first overlap area is greater than the second overlap area, correcting 

9 perspective distortion in the second \>ne of the peripheral images relative to the central 
1 0 one of the images. 

1 25. The article of claim 25 wherein the stqred instructions further comprise instructions 

2 operable to cause the computer to: 

3 prior to blending the set of images: 

4 if the first overlap area is les^ithan the second overlap area, correcting 

5 perspective distortion in the second one o^ the peripheral images relative to the first 

6 peripheral one of the images. 
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26. The article of claim 2d wherein blending the images further includes: 

dividing the secona^mage into a first portion and a second portion, based on the first 
position; 

compositing the first pdrtion of the second image on the first image at the first 
position to produce a composite image; the compositing causing the first portion to mask 
out a part of the first image; 

blending the third image ^ith the composite image to form the panoramic image. 

27. The article of claim 27 wherein blending the third image with the composite image 
further includes: 

dividing the third image in\o a third portion and a second portion, based on the 
determined second position; 

dividing the third portion irijto a fifth portion and a sixth portion, based on the 
determined third position; and 

compositing the fifth portionlof the third image on the composite image based on the 
second position to form the panoramic image, the compositing of the fifth portion causing 
the fifth portion to obstructs at least a part of the composite image. 
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